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ABSTRACT 

This volume is a discussion of research that resulted 
in a system for developing task summaries for writers of soldier*s 
manuals. It is intended for people who will evaluate the system and 
for developers of task performance instructions (TPI) and their 
supervisors. First, some problems with the soldier*s manuals, the 
basic written instructions for performance of critical tasks in most 
Army jobs, are considered. Some of the findings of research on the 
design of printed instructions are then addressed. The three 
principles involved in the model for developing task summaries, 
called the TPI system, are described sequentially. They are 
relevance, directness, and sufficiency. A discussion follows of 
provision in the TPI system for considering the needs of particular 
kinds of readers. The method section discusses the way the TPI system 
was developed using an empirical, differential, and structural 
approach. A demonstration experiment to compare effectiveness of 
original and revised instructions is described in the final section. 
These results from the experiment involving instructions on filling 
out a standard maintenance form are reported: the revision reduced 
errors in checking entries by 64 percent, and people indicated 
greater confidence when followinq the revised instructions and found 
them much easier to understand, (ylb) 
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FOREWORD 



The Fort Hood Field Unit of the US Army Research Institute for the Behavioral and 
Social Sciences (ARB provides support to Headquarters, TCATA (TRADOC Combined 
Arms Test Activity) and to HI Corps. The support for m Corps involves investigation of 
training and other human factors problems that are common to FORSCQM units, including 
individual training. 

The modem Army requires large numbers of soldiers to know how to perform a wide 
variety of tasks. Soldier's Manuals are the basiQ written Instructions on how to do the 
important tasks for each Job. 

This report describes a system for developing task performance instructions (tFD 
foE Soldier's Manuals. Volume I is a report of some related studies, of the method used in 
developing the system^ and a demonstration experiment that was conducted* Volume His ' 
a developer's guide to be used in implementing the system. 

The TPI system provides principles for revising the basic structure of instructions to 
meet particular needs of soldiers. This approach differs from many previous studies, 
which tended to focus attention on details of wording. One unusual technique is 
integrating wording and illustrations to specify responses. Another innovation is to 
cluster instructions ggi that they apply to specific respbnses. The approach also involves 
classification of tasks, so that relatively specific guidance can be given to developers. 

ARI research in this area is conducted as an inhouse effort^ and as joint efforts with 
organisations possessing unique capabilities for human factors research. The research 
described in this report was dor^ by personnel of the Human Resources Research 
Organisation (HuajRRO), under Contract No. MDA903*79-C-0191, monitored by Dr. 
Charles O. Nystrom from the ARI Fort Hood Field Unit. This research is responsive to 
the objectives of RDTE Project 2Q262717 A790, "Human Factors and Training Research ir. 
Military Organisations and Systems," FY 1980 Work Program. 

Credit and appreciation is due Dr .Robert G. Cooper, who conducted the demonstra* 
tion experiment reported in Volume I* 




Joseph zhc/ner 

Technical Director 
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HOW TO DEVELOP TASK SUMMARIES FOR SQLDIER^S MANUALS. 
VOLUME L TECHNICAL REPORT 



^ BRIEF 



Requirement: 

Soldier's Manuals (SM) are the basic written instructions for performance of critical 
tasks in most Army jobs. SM are intended as a sufficient C'one-stop**) learning guide for 
those tasks, and are a key element of the Enlisted Personnel Management System (EPMS). 
Since they first appeared in 1976t SM have demonstrated great promise* but various kinds 
of problems have also become apparent^ as might be expected in so vast a system. 

The major research objective is a system for improving task performance instruc- 
tion3 (tPD in SM. A related objective is a developer's guide for implementing that 
system. 



Procedure: 

Several task summaries from curren'. SM were revised to serve as examples* and to 
provide an empirical basis for the principles of revision. The method involves basic 
restructuring of TPl to meet the needs of the soldier. A classification of tasks was 
developed so that guidance for developers is relatively specific. 



Principal Findings: 

•bistructions in SM opuld be much briefer and more effective, 

*TPI may be improved substantially by techniques using illustrations 
to specify action. 

^Different instructional strategies are needed for different kinds of 
tasks« \^ 

*Task performance and reader confidence are improved significantly ^ 
when instructions are revised by the TPI system. 

Utilizat^n of Findings: 
. 

Soldier's Manuals may be improved by following the Developer's Guide, which is 
Volume H of this report. 
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HOW TO DEVELOP TASK SUMMARIES FOR SOLDIER*S MANUALS 
VOLUME 1: TECHNICAL REPORT 



This volume is a discussion of research that resulted in a system for developing task 
summaries. It is writtr>i primarily for people who will evaluate the system, includiDg 
those who determine policy and others who are involved in related resesirch. It is also 
intended for developers of task performance instructions (TPI) and their supervisors to 
supplement Volume H of this report. Developers should read that first, then scan this 
report later. 



BACKGROUND 

Soldier's Manuals (SM) were first introduced in 1976 to describe "in detail the tasks 
that are critical to survival and successful mission performance** for every soldier. These 
manuals were intended to be "a well-illustrated one-stop training and evaluation guid$>*'l 
First, we will consider some problems with the manuals, and then some of the findings of 
research on the design of printed instructions. 

PROBLEMS WITH SOLDIER'S MANUALS 
Survey 

The effectiveness of current Soldier's Manuals is evaluated in an unpublished survey 
by American bistitutes for Research (AIR) under contract with the US Army Research 
Institute for the Behavioral and Social Sciences (ARD.^ In considering the survey results, 
one should bear in mind that the survey method is appropriate for revealing symptoms of 
problems, but it is not likely to generate a coherent set of design Principles . The survey 
team offers many useful suggestions, but they are limited in the extent to which they can 
extrapolate from their data. 

General opipi<His Soldier*s Manuals . The Soldier's Manuals are regarded as 
generally a good idea by officers and senior enlisted people, but substantial problems 
remain* Their purpose is often ambiguous, particularly in relation to career advancement. 
Apparently, many soldiers do not use SM at alL When SM are used it is usually in 
preparation for Skill Qualification Testing (SQT), and not for job duties. SM sire not 
widely used in conjunction with other training, such as Advanced Individual Training (ATT). 



*US Department of the Army. TRADOC Circular 351-28, Fort Monroe, Virginia: 
TRADOC, 4 December 1978, para 3-la, Chapter 3. 

^Lnformation^Review copy of draft report. Evaluating effectiveness of Soldier's 
Manuals. Alexandria, Virginia; US Army Research bistitute for vie Behavioral and Social 
Sciences, 1980. 



1 



Soldier's Manuals ^e used more often in combat Military Occupational Specialties 
(MOS) than for jobs where the people perforin their intended function dally. That would 
suggest that non-combat jobs might require different techniques of training and evalu- 
ation than combat MOSw 

Completeness . While the survey report Reneraliy supported the Idea of a "piu;-*top" 
Soldier's^anualt it revealed some problems with that concept'. Opinions were rather 
evenly divided on whether the SM were incomplete^ about right, or were too bulky 
already. The dilemma of detail versus bulk, however, may be so. lewhat an artifact of the 
survey method. The TPI revisions in Volume H include many cases in which the original 
mstrictions were both insufficient and unnecessarily long, becar^se parts were vaguet 
verbose, redundant and irrelevant. The survey report suggested ways to repackage SM to 
save bulk. 

Forniat. The survey report suggested that a standard format be adopted, noted 
the awkwardness of the ter^ii "performance measures,** and suggested "task steps** instead^ 
They noted a need for describing ^'initiating cues to performance of the task**; that ist the 
circumstances that would^^ll for performance of the task* 

ReadabtUty . Most soldiers found the words in SM easy to understand. But many 
samples w^re found to be rather difficult according to readability formulas, in relation to 
the average soldier^s reading skills. The median sample was at the 10th to Hth grade 
level of reading difficulty.. That paradox may also be an artifact of the ^vey method, 
because of the respondents' expectations. Most people are so accustomed to poor 
technical writing that they do not appreciate how much better It could be. The current 
SM are a substantial improvement over other mc nurls, even though they are far short of 
the ideal. . ' * , 

Other probleiDSf The survey reported an aln^osf total lack of fiek. testing of SM or 
tryouts of any kind. It also reported problems with the physical construction of the 
manuals, especially their bindings^ 

Suggestions From TRADOC 

The following list of commonly reported problem areas was suggested by people at 
the SQT Management Division, TRADOC, which monitorfi^the development of Soldier's 
Msuiuals. 

1. Use of illustrations^ 

2. Specifying standards; product or process. 
3^ Supervisory tasks. 

4, Generic tasks (e.g«, using Lubrication Ord^ to lubricate any one of 
several kinds of equipment). 

5. Citing references, ^ ^ 
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6. Using test equipment (e.g., using multimeter) chat is specific to the 
kind of. equipment tested. 

These problems were therefore addressed in this recearch. 



PRINCIPLES FOR PRINTED INSTRUCTIONS 
Military Studies 

The military services have long been prominent in research on readability.^ Kern, 
Sticht, Welty, and Hauke^ consolidated much of the available information in a guidebook 
for developers of Army training literature* They distinguish between topic-oriented and 
performance-oriented writing, and give numerous comparative examples and problems in 
revision. Our system is an attempt to make the Titinciples o? performance -oriented 
writing more specific, particularly as applied to Soldier s Manuals. 



Recent Devetopnientft 

Various research disciplines are related to design of printed instructions. These 
have recently been reviewed.^ Recent developments show not only increasing interest in 
document design, especially in civilian institutions, but also a shift in attention toward the 
basic structure of documents, rather than details that are measured by readability 
formulas. 

Qr f^anj^^tional ettorts . One sign of increasing concern among civilian institutions is 
the rewriting of federal regulations for clarification.^ Also, the "Clear Language 
Movement***^ has led sev^'-'-al states to pass laws requiring clear, simple language in public 
documents. Another positive sign is the Document Design Project which began in 
September 1978, under funding from the National Institutes for Education (NIE). That is a 
joint effort of AIR, Carnegie-Mellon University, and Siegel and Gale, Inc., "to foster clear 



^T. G. Sticht & D. W. 2apf (eds.). Reading and readability research m the arme d 
services (Pinal Report PR*WC(C A)*76*4)* Alexandria, Virginia: Human Resources 
Research Organization,. September 1976. 

\. P. Kern, T. G. Sticht, D. Welty, & N. Hauke. Human Resources 
Research Organization. (P 75-3). Guidebook for the development of Army 
training- literature . November 1976. Alexandria, Virginia: US Armiy Research 
Institute for the Behavioral and Social Sciences, (AD A033 935). 

Document design: A review of the relevant research 
(AIR*7500-4/80*TR). Washington, DC: American fcstitutes for Research, April 1980. 

6l. S. Flower, J. R. Hayes, 8t H. Swarts. Revising functional documents: The 
acenario principle (Technical Report No. 10). Washington, DC: American Institutes for 
Research, March i980, p 1. 



''ibid. 
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and simple writing and design of public documents,"^ Unfortunately, there is little 
agreement on what "clear language'* or "plain English" really is,^ But many researchers do 
agree on the kinds of principles that are needed to guide revisions. 

Basic structure . Current research is shifting attention to the basic structure of 
functional documents (i.e., task related). For instance, Bond, Hayes, and Flower'^ report 
that the most effective revisions of a legal document involve comprehensive changes, 
including reorganization, more suitable format, and consideration of the reader's needs. 
People w^o make ineffective revisions think the original was understandable, and make 
minor changes in wording. This kind of study is a departure frorii earlier studies which 
tended to focus on the readability formulas (words per sentence . and syllables per word). 

Readability fonnulas . Some people have always questioned the efficacy of 
readability formulas ar^ guiding principles, and others are adopting that viewpoint. Li a 
recent review of the research. Kern said bluntly: " Rewriting to lower the formula's 
reading grade level does not increase comprehension." ^^ Kern even goes so far as to 
suggest that writing to the formulas is actually a distraction from the more important 
goal of "organizing material to meet the readers^ information needs." This does n o t mean 
that readability formulas axe useless; they do reflect important aspects of pros^^, and any 
writing that scores badly |s at least suspect. But readability formulas should not be the 
first thing or the only thing a writer thinks about when revising instructions. 

Needed igiaciples . A dear statement of the new direction is given by Flower, 
Hayes, and Swarts.^*^ They define the goal as "a set of powerful principles which would 
allow writers to revise public documents so that they meet the needs of the readers who 
must iise them (underlining theirs). They note that "in a large organization such as the 
government, most writing tasks are essentially revision rather than original composi* 
tion.''^^ They also relate such revision to the reader's information processing; revision 
should "make it easier to hold and relate manageable -sized units in short*term 
memory."14 Their study is an analysis of protocol; i.e., the way people discuss a federal 



^Felker, 0£. cit ., p. |. 

9v. R. Charrow. What is "plain English", anyway ? Washington, DC: American 
Institutes for Research, December 1979. 

l^S. J. Bond, J. R. Hayes, h L. S. Flower. Translating the law into common 
lanimage: A protocol study (Technical Report No. 8). Washington, DC: American 
Institutes for Research (with Camegie*Mellon and Siegel & Gale), April 1980. 

^h. P. Kenv. Usefulness of r ^:.H.bllltv formulas for achieving Army ^^^^^^^^^^^ ^ 

applied to the Arrm^-s problem. (Technical 
£lort A37i. rwndrla, Virginia: US Army^Sesearch Institute f^r the Behavioral and 
Social Science^;, January 1980, p vlll. (AD A086-A08) 

l^FIower, Hayes, & Swaxts, ^ cit., p 1. 

^^Flowcr, Hayes, & Swarts, ^ cit.» p 2. 

^^Flower, Hayes, Sn Swarts, o£ cit., p 4. 
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regulation as they try to interpret it. They found that readers generally express the 
meaning of the regulation "in the form of a concrete story or 

event, e.g., with a Condition/ Act ion sequence or with Agents and Actions/^^ They 
recommend using such expressions in revision; they call this the "scenario principle," 

Reaearch metbods . Many of the recent studies are also noteworthy for using 
protocol analysis as a research method* The resulting principles are based on empirical 
generalizations of the details of the revision process, rather than a priori notions about 
what should be important. A similar empirical method is task analysis, which Gagnel° has 
described as the most significant contribution of psychologists to military training. 
Recently, Sanders^^ i^^s discussed the advantages of the empirical approach in discovering 
principles of instruction. 



Our research produced a model for developing task summaries, called the Task 
Performance Instruction (TPD system. It involves a coherent set of principles for 
structural revision, consonant with many of the recent studies: These general principles, 
described below, wilt serve as an introduction to the Method section, which Is a discussion 
of the way the TFI system was developed. The TPI system is elaborated in Volume IL 

The model involves three principles of simplification: (1) relevance, (2) directness, 
and (3) sufficiency. They are applied sequentially as described below. Following that Is a 
discussion of provision in the TPI system for considering the needs of particular kinds of 
readers. 



RELEVAHCE 

The first step in revision is to screen the available information for relevance to task 
performance. Lrrelevant information is eliminated. 

DIRECTNESS 

Directness is minimizing the number of steps required of the reader in following 
instructions. Often a set of instructions requires numerous steps besides those involved in 
task performance. By eliminating extraneous steps, revision may provide a "shortcut.** 



ISpiower, Hayes, 8t Swarts, 0£cit., p 14. 

^^R. M. Gagne. Military training and principles of learning. American Psychologist, ^ 



1962, il, 83-91. 

l^D. P. Sanders. Educational inquiry as developmental research. Educational 
Researcher^ l981, 10(3), 8-13. 
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Any reasonable set of instructions in\ dadily apparent sequence for reading. 

If the intended sequence is not apparent, rev^^ ^ ast make it so before further analysis. 
When revision eliminates several unnecessary steps, there is an obvious simplification, 
increasing directness is the primary means of reducing the load on short-term memory. 
Thus, it greatly simplifies the reader's task. Two techniques are used to increase 
directness: sorting by responses and reducing each cluster of instructions. 

Sorting by Responaes 

The first way to eliminate extraneous steps is to sort each item of task relevant 
information according to the response to which it applies. Jn the revision there should be 
a cluster of information associated wilh each response. After each cluster of informa* 
tion, there is an implied ^execute** command so that the reader can act on it immediately, 
without reading further. That is quite different from conventional instructions, which 
require reading everything before taking any action, and then mentally sorting out the 
information so that it applies to particular responses. Even if the reader is only 
previewing the instructionSf clustering by responses provides a structure for comprehen* 
sion and recall. 



Redttcing Each Cluster of higtructiocs 

Another way to minimize steps is to reduce required reading for each response. The 
most important techniques involve special kinds of ^ "integrated" illustrations which 
eliminate the need to refer back and forth between pictures and text. For example, 
compare Figures 1 and 2. Another technique is to eliminate redundancy in specifying 
responses. The most serious, most common kind of redundancy is to illustrate various 
responses, and then repeat it all in the text, in tiresome and confusing detail. (See Figure 
1.) 

SUFFICIENCY 

Sufficiency is a matter of assuring that each cluster of instructional information 
will produce the intended response. Sufficiency consists of having (1) a comprehensive 
rule specifying each response, and (2) an '^embedded" example involving all response 
elements* 



Comprehensive Rules 

A comprehensive rule is one that specifies the responses under all circumstances. 
Such a rule may be a formula, a set of qualifying conditions, or even a simple listing of all 
acceptable responses. For example, a comprehensive rule for any entry on a standard 
form may begin "Use one of the following entries:..." A similar rule may be practically 
comprehensive; e.g., ''The following entries cover the common situations:...** Several 
varieties ^f comprehensive rules for entries on standard forms are in the revised 
instructions for DA Form 2408*14 (Appendix A), which was evaluated in a demonstration 
experiment that is described at the end of this report. 
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Figure 1. Original instructions. 



b. To check the firing wire: 
(1) Twist wire together 




(2) Then untwist wire and 
test again^ lamp should 
not flash 



Figure 2. Revision, which integrates text and illustration. 
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Embedded Examples 



An embedded example of a procedure is one that is continued throughout the 
instructions as each response is specified by rules. This allows immediate application of 
each mle as it is defined. The conventional practice is td specify al! responses first in 
terms of abstract rules, and then (perhaps) give an example. This way, the reader must 
try to remember abstract rules until he or ^e can determine where each rule applies in 
the example. 

With embedded examples, sometimes even the rules are stated in terms of the 
example, with other circumstances covered only by implication. Such rules BO^e involved 
in the revised instructions for *'Zero the M203 grenade launcher** discussed in Chapter 5 of 
the Developer's Guide. The use of embedded examples is similar to the "scenario 
principle" proposed by Flower, Hayes, and Swarts. ^8 



NEEDS OF THE READER 

The principles for revising instructions should somehow take into account the 
various needs of readers. A method often discussed (but seldom applied) is to consider 
aptitude-treatment interaction (ATD and write instructions at different levels. This does 
not seem either necessary or feasible for Soldier's Manuals for reasons that are discussed 
below. A better way of meeting particular needs is to consider task cjieu^act eristics in 
order to give more specific rules and examples for writers so that TFI may be well suited 
to the tasks at hand. 

Aptitude X T^atment hteraction 

Felker says that: 



An aptitude x treatment interaction exists when individuals at one 
end of an aptitude variable perform best with one type of instruc- 
tional stragegy (treatment) and individuals at the other end of the 
aptitude variable perform best with a different instructional 
strategy. 19 



The TFI system involves a working assumption that ATI is not an important consideration 
for SM task instructions, so long as they meet certain criteria: (1) extreme brevity, (2) 
hierarchical organisation, and (3) coverage of all specialized concepts and operations. 
Brevity should ensure that no one spends much time Te^ading the instructions. Revising 
TPI for any task should reduce the number of words by half or more, with even greater 
savings in time to comprehend them. The high degree of organisation should provide more 
capable people rapid access to the particular information they seek. 



ISpiower, Hayes, 8c Swarts, pp cit. 
l^Felker, 0£ cit., p 59. 




Most SM tasks are rather sitnple and require little background information. If that 
information is not common knowledge, it should be taught within the SM as "specialized 
concepts and operations/ Such instruction r y be included within the TPI where it is 
needed, or taught elsewhere as a "subroutine' common to many tasks. Whichever method 
is chosen, there should be assurance of coverage somewhere. 

A similar idea i' the "skills hierarchy" that is often used in instructional analysis. 
This term was avoided because it seems to imply that any subordinate skill is included 
entirely within a higher level of performance. This is often the case, especially in 
mathematics. But often two tasks have only a few respnTises in common, so the 
expression "specialized concepts and operations" seems more descriptive. It also seems to 
describe the kind of relationships involved. 

Soldiers with higher aptitude will undoubtedly be able to comprehend any instruc- 
tions faster and better. But this does not justify separate sets of instructions for 
different levels* Such justification would require that more capable soldiers could learn 
even fasten by another treatment, with enough advantage to warrant development of 
alternate instructions. Anyone who proposes alternate levels of instructions should 
consider the examples of revised instructions in the Developer's Guide, and try to identify 
parts that could be reduced or eliminated to save appreciable amounts of time for some 
soldiers, bstructions can hardly be too simple if they are sufficient for the task. The 
suggested rule is: high ability readers want simplicity, but low ability readers nee^ 
simplicity. 



Task Characteristics 



The "needs Of the reader" are primarily a matter of the task that he or she is 
required to perform. Therefore, a detailed task classification system was developed so 
that the rules and examples could be much more specific to those needs. As more TFI are 
developed, the classification system may allow developers to make appropriate general!* 
zations to other tasks of the same category. The classification system may also be useful 
in identifying problems and issues. 



The TPI system was developed f^om many detailed observations of the revision 
process. Those Observations were organized and reorganized repeatedly to better serve 
the goals of the system. For instance, the set of revision principles (relevance, 
directness, and sufficiency) was not conceived a priori as a coherent system. Rather, 
those criteria were formulated after revising many TFI, while writing about the 
Instructions for "Uncorrected Fault Record" (DA Form 2408-14). Later those criteria 
were sequenced and elaborated. 

lite method of development may be called the empirical*differential*structural 
(EDS) approach. 'Empirical' refers to the detailed observations that were the basis Of the 
development. "Differential' describes the attempt to develop: relatively specific guidance 
for different circumstances that affect development of TPL 'Structural' refers to the 
efforts to organize the various rules for development into a coherent system. 



METHOD 




EMPIRICAL OBSERVATIONS 



Empirical observations are based on experience that is ,not structured by formal 
experiments or explicit theory, but is subject to verification in lortnal experiments. The 
observationst for the most part, were made by the author about his own revision of 
instructions. The method is similsir to protocol analysist but the revision is done by 
reseeo^chers themselves. 

Such observations are a form of task analysis. MHien the observations are 
summarized as systematic practices* they gain some credence on rational grounds. Here 
task analysis is considered as a reseeo^ch toot for developing instructional methods* rather 
than a production method. 



DIFFERENHAL TBCHN]QUES 

Principles that are effective for developing one kind of instruction may be 
ineffective or inapplicable under different circumstances. An important research 
objective was to determine what kinds of circumstances made that kind of difference. 
Those circumstances were generally related to the kind of task that the soldier is to 
perform. 

Consider* for example* the difference between procedures with equipment and 
procedures with data. The basic consideration is that procedures with data require 
written responses* which are ea^ to specify in printed instructions. That makes 
development of TPI much easier* if the procedures involve only dfita* so the distinction is 
useful. Procedures with equipment* on the other hand* inyolve specjf ication of motion* 
psirts of equipment* viewpoint* and sometimes other crew^mbers. The distinction is not 
in terms of basic processes involved in task performance* because those processes sire not 
unique; procedures with equipment generally involve some kinds of data. 

The tastk examples were selected to be representative of the kinds of problems that 
developers would face. There was a deliberate attempt to select tasks and problems that 
were different from those previously encountered. 



STROCTURAL DEVELOPMENT 

The various distinctions that seemed related to training methods were organized 
into three classifications: (l) kinds of tasks* (2) components of illustrations* and (3) 
functions of illustrations. The classification of tasks was designed as a tool for task 
analysis* Each kmd of task is discussed separately* allowing the guidebook to be relatively 
specific in suggesting instructional strategies. 

The classification relating to illustrations were used to derive techniques for 
relating words and pictures directly* and to promote skill in using "action" illustrations to 
specify responses. However* they were too elaborate for discussion in a ba ic ^debook. 

The classification systems and other aspects were interrelated by similar means* so 
as to provide an effective* systematic and easy-to-follow method for developers. There 
was frequent rearrangement of the system as more TPI were revised and rules formulated* 
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DEMONSTRATION EXPERIMENT 



A demonstration experiment was conducted comparing effectiveness of original and 
revised instructions for the "Uncorrected Fault Record" (DA Form 2408*14), The 
revision followed the TP! system, as discussed in Chapter 5 of the Developer's Guide, so 
the results should indicate efficacy of the method. 



PROCEDURE 

Twenty-six college students tried to find six errors in a military maintenance 
record. They used standard technical manual instructions {TMD one time and TP! another 
time for this unfamiliar task. The order in using TMl and TPI was counterbalanced with 
two alternate forms of the maintenance record test. All students were also asked to rate 
their confidence in their answers and to compare the instructions for ease in understand* 
ing. Twenty minutes were allowed for each attempt to use the instructions on the test 
maintenance record. The time allowance was more than enough for all students 
completing the tests. Three others were dropped because they could not or would not 
complete the task with the original set of instructions. The problem and answer sheet is 
shown on the following page, along with the rating scales. 

RESULTS 

The revised instructions were significantly better on all three measures: greater 
accuracy, greater confidence, and easier to follow ( p <.01, each criterion, sign test). The 
raw data are shown in Table 1* The only individual who scored better following the 
original ii^structions was below chance on both versions of the task. 

TPI was much better than TMI, but TMI was, very poor. Only four percent of 
students using TMI found all six errors**as compared to Z6% of TPI users. If the air of 
TPI is to lead unfamiliar students to perfect test performance, then TPI could also be 
improved. However, this was simply a demonstration experiment. The percentages 
cannot be taken to estimate performance parameters for realistic samples of military 
tasks or soldiers. Further research is needed in order to demonstrate the validity of the 
system with respect to other kinds of tasks. 



IMPUCAT[ONS 

The demonstration merely shows the direction of differences and suggests that very 
large gains may be expected relative to poor existing instructions. The important 
practical ^iti^plication is that such simple counterbalanced designs might be used in 
practice to emnire that the TPI meet the needs of the users. The student ratings of 
confidence and ease in following instructions were markedly in the expected directions. If 
the experiment has been conducted as part of the TPI dev'elopmentsil process, the students 
might also have suggested useful specific improvements in the TPL Such demonstration 
experiments In the course pi TPI production would finally show the point of dbninishing 
returns in any practicsil prog^m to improve performance. . 
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Assume that you are a supervisor checking the entries in this "Uncorrected 
Fault Record" form. Which of these entries are wrong? (See instructions 
on the foUowinq ijaq?,) . 



/9/2//P/P \/ 



t4 41 



J -r,:.:::;;-" .-_r. - 



i i 1 . 




^ A/6Ur rA^CK " - 



i 



-(ASSUME THESE ENTRIES ARE CORRECT) 



After you are through, answer these questions: 



How confident are you of your answers? 



random fairly extremely 

guess unsure confident confident confident 

I ! L_ L I 

Which set of directions were easier to follow? S 

1^ 

1st 1st a 2nd a 2nd 

much little about little much 1 

easier easier even easier easier 



3 ■ 



ua O t, 

1 t i ^ ^ § 




TABLE 1. Comparative Data on Original and Revised bistnictions 
for Uncorrected Fault Record 



♦Subject 
No. 



Original 
Score Confidence 



Revised 
Score Confidence 



Relative 
Ease 



4 

1 


4 


5 , 


6 


4 


5 


2 


3 


2 




4 




3 


3 


1 


5 


3 


4 


4 


2 


3 


4 


5 




5 


4 


3 




4 




6 


3 


2 


4 


4 


4 


7 


3 


2 




4 




<l 


5 


3 




4 


4 


9 


4 


3 


5 


4 




10 


2 


2 




4 


? 


11 


6 


2 




4 


4 


12 


2 


1 






c 


X 


3.42' 


2.42 


5.33 


3.92 


4.67 


13 


4 


3 




3 


4 


14 


3 


3 


4 


4 


3 


15 


2 


1 


1 


1 


3 


16 


4 


3 


6 


4 


4 


17 


4 


2 


4- 


3 


4 


IS 


4 


3 


6 


4 . 


5 


19 


4 


4 


5 


5 


5 


20 


5 


4 


5 


5 


4 


21 


5 


4 


6 


5 


4 


22 


4 


3 


5 


3 


4 


23 


6 


3 


6 


4 


5 


24 


4 


3 


6 


4 


4 


25 


4 


3 


5 


3 „ 


4 


26 


4 


2 


6 


4 


4 


X 


4.07 


2.93 


5.07 


3.71 • 


4.bO 




3.74 


2.69 


5.19 


3.81 


4.31 



(both orders) 



Score Confidence Scale 

maxlniun) 1 - random guess 

possible 2 * unsure 

is 6 3 * fairly confident 

4 - confident 

5 - extremely confident 



Relative Ease 

1 - original much easier 

2 - original a little easier 

3 - about the same 

4 - revised a iittle easier 

5 - revised much easier 



♦Subjects 1-2 used the original instructions first, and 13-26 used the revised instructions 
first. 
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, APPENDIX A 

Original Instructions and ReTised lostructiofia for 
'Uncorrected Fault Record* 
(DA Form 2408-14) 
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TASK: Fill Out DA Form 2408-14 



Conditions: In filling out DA Form 2404 there was u fault that could not be 
corrected immediately, .but the equipment was still operable. (This page is 
for equipment other than aircraft. Aircraft faults are discussed on tr^ 
following page.) 



ing page. 

Use nomenclature and model numbers 
from TM- 38-750, Appendix E 



f 



From vehicle inspection log, or from 
nomenclature plate on vehicle 





I 



-defined in TM-38-750 
para 4-2 c{l) 



Use one of the following: ^ 
X - deferred maintenance action,^ 

equipment still operable 
/ = deficiency that only degrades 

efficiency 
- = potentially dangerous 
Do not use "x" because it means the equipment is inoperable, and you 

should use DA Form 2407. - / 

Do not erase status symbol if it is an error. Instead, draw a line 
through the whole entry and start again on the next line. 

Copy verbatim from 2404, column c. 

Give reason for delay and information about action taken, such as: 
NSN (National Stock Number] 
qSS or SSSC 

m d^t^ t'nat part was requested 
sV/ork order number (in case of backlog) 




T — 




Date of e 

Signature of commanding officer or designated representative. 

V!hen the fault is corrected, the person who does it writes the date 
in the last column and his larst name initial over the status symbol . 

Disposition: Six months after the last fault is corrected, this form may be 
discarded. 
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